Skip to content

Run Apache Spark SQL workloads on Azure Cobalt 100 Arm64 using Gluten and Velox for accelerated analytics - #3199

Merged
pareenaverma merged 2 commits into
ArmDeveloperEcosystem:mainfrom
odidev:spark-velox
Apr 27, 2026
Merged

Run Apache Spark SQL workloads on Azure Cobalt 100 Arm64 using Gluten and Velox for accelerated analytics#3199
pareenaverma merged 2 commits into
ArmDeveloperEcosystem:mainfrom
odidev:spark-velox

Conversation

@odidev

@odidev odidev commented Apr 23, 2026

Copy link
Copy Markdown
Contributor
  1. Install and configure Hadoop, Spark, and Hive on Azure Cobalt 100 Arm64 virtual machines
  2. Build and integrate Gluten with the Velox backend for native query execution
  3. Configure Spark SQL for columnar and vectorized execution
  4. Generate and load TPC-DS datasets for benchmarking
  5. Run Spark SQL workloads and compare performance between vanilla Spark and Gluten + Velox
  • [ * ] I have reviewed Create a Learning Path
  • [ * ] I have checked my contribution for confidential information
    By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of the Creative Commons Attribution 4.0 International License.

Signed-off-by: odidev odidev@puresoftware.com.

… and Velox for accelerated analytics

Signed-off-by: odidev <odidev@puresoftware.com>
Set the draft status for the Spark Velox Cobalt index page.
@pareenaverma
pareenaverma merged commit 30eef4f into ArmDeveloperEcosystem:main Apr 27, 2026
2 checks passed
@anupras-mohapatra-arm anupras-mohapatra-arm added ready_to_publish Ready for final review and publish and removed editorial_review labels May 4, 2026
@pareenaverma pareenaverma moved this from In Progress to Done in Arm Learning Paths Roadmap May 9, 2026
@pareenaverma pareenaverma added publish and removed ready_to_publish Ready for final review and publish labels May 15, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ACM Arm Cloud Migration publish

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

4 participants